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Abstract: A MacWilliams Identity for convolutional codes will be established. It makes use 
of the weight adjacency matrices of the code and its dual, based on state space realizations 
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1 Introduction 

> 

oo . The weight enumerator of a code keeps track of the distribution of codeword weights and 

therefore is of paramount importance for the error-correcting capabilities of the code in 
question. One of the most celebrated results in block code theory, the MacWilliams Identity 
f-*) ■ Theorem, states that the weight enumerator of a block code completely determines the weight 

OO ! enumerator of the dual code and gives an explicit transformation formula. The practical and 

theoretical implications for block code theory have been studied ever since, see for instance 
[la Ch. 11.3, Ch. 6.5, Ch. 19.2] or [TOl Thm. 7.9.5]. 

^ ■ For convolutional codes only partial results concerning a possible MacWilliams Identity 

could be established so far. About 30 years ago it has been shown by a simple example that 
the classical weight enumerator as introduced by Viterbi [21] does not obey any MacWilliams 
type of identity, see |20j . In other words, this weight enumerator is too coarse in order to 
yield detailed information about the dual code. This insight gave rise to the study of a 
more refined weight enumerating object, the weight adjacency matrix (WAM). It has been 
introduced in p^, but appears already in different notations earlier in the literature. Indeed, 
one can show that it basically coincides with the labels of the weight enumerator state diagram 
as considered in [1]. The WAM is defined via a state space description of the encoder as 
introduced in [16]. It is labeled by the set of all state pairs {X,Y), and each entry contains 
the weight enumerator of all outputs associated with the corresponding state transitions 
from X to Y. The resulting matrix contains considerably more information about the code 
than the classical weight enumerator mentioned above. Indeed, it is well-known [18j . [7] how 
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to derive the latter from the WAM. Unfortunately, the matrix by itself is not an invariant 
of the code, but rather depends on the choice of the encoder and the state space realization. 
However, this dependence can nicely be described and upon factoring out a suitable group 
action results in an invariant of the code, the generalized WAM. 

In a previous article [8] we studied this invariant in detail, and, in particular, we could 
establish a weak MacWilliams type of identity for the generalized WAM. It states that a 
certain transform of any WAM of a given code results in a matrix having up to ordering the 
same entries as any WAM of the dual code. For the class of codes with all Forney indices 
being at most 1 we could even show that this ordering is actually induced by a state space 
isomorphism, which can also be given explicitly. Of course, the isomorphism depends on 
the chosen representations of the code and its dual. This result generalizes a MacWilliams 
identity established in [Ij for the class of codes of degree 1 (that is, only one Forney index 
has the value 1 while all other indices are zero). 

In this paper we will extend the result to arbitrary CC's. In other words, we will establish 
a MacWilliams Identity for the full class of CC's. Stated more precisely, given a code and 
its dual with chosen state space representations we will give an explicit transformation of 
the WAM that will result in the WAM of the dual code. The result generalizes the classical 
MacWilliams Identity for block codes. 

The main outline of the paper is as follows. In the next section we will introduce the 
basic notions of convolutional coding theory including state space realizations as well as two 
block codes closely related to the given CC. In Section [3] we will introduce the WAM as well 
as the MacWilliams transformation matrices, and we will state the MacWilliams Identity. 
Section S] will be completely devoted to the proof of the MacWilliams Identity and therefore 
will be rather technical. A detailed example will illustrate the steps of the MacWilliams 
transformation. Finally, in Section [5] we will discuss an alternative notion of duality for CC's 
and translate our result to that notion. 

The following notation will be used throughout. For any domain R and any matrix 
M G i?""^* we denote by imM := {uM \ u e i?"} and kerM := {u e R"" \ uM = 0} 
the image and kernel, respectively, of the canonical linear mapping R" I — > R^, u I — > uM 
associated with M. 

2 Preliminaries 

In this section we will collect the main notions of convolutional coding theory as needed 
for this paper. Let F be a finite field. A k-dimensional convolutional code of length n is a 
submodule C of F[L']" of the form 

C = imG := {uG\ue¥[D]''} 

where G is a basic matrix in F[L)]'^^", i. e., there exists a matrix G G F[iD]"'^*' such that 
GG = Ik- In other words, G is noncatastrophic and delay-free. We call G an encoder and 
the number 6 := max{deg7 | 7 is a /c-minor of G} is said to be the degree of the code C. A 
code having these parameters is called an {n,k,6) code. A basic matrix G G F[D]'^^" with 
rows gi, . . . ,gk G F[D]" is said to be minimal if Yli=i deg((7i) = 6. For characterizations of 
minimality see, e. g., [3j Main Thm.] or [n\ Thm. A. 2]. It is well-known [3', p. 495] that 
each code C admits a minimal encoder G. The row degrees deg^j of a minimal encoder G 
are uniquely determined up to ordering and are called the Forney indices of the code or of 
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the encoder. It follows that a CC has a constant encoder matrix if and only if the degree is 
zero. In that case the code can be regarded as a block code. 

Throughout the main part of this paper the dual of a code C Q F[D]" is defined as 

C:={w £ ¥[D]"' I wv'^ = for all v G C}. (2.1) 
In other words, the dual code C is the orthogonal of C with respect to the F[D]-bilinear form 

((Wl, . . .,Wn), (Vl, . . . I > Er=l ■^i^i ^ ^i^]- 

In Section [5] we will address a different notion of duality that has been introduced in the 
literature on CC's as well, and we will show how our result can be translated to that notion. 
Duality as defined in (|2.ip has been considered in, e. g., [1], [2], [3], [l^, and [20]. It is well 
known [iTl Thm. 7.1] that 

if C is an (n, k, 6) code, then C is an (n, n — k,d) code. (2-2) 

For a block code V Q¥^ the dual is denoted by := {w E | wv^ = for all v € V}. 
The different notation C versus for the dual of a convolutional code C versus the dual of 
a block code V will be helpful later on. 

The weight of convolutional codewords is defined straightforwardly. For a polynomial 
vector V = J2f=oV^^^D^ € F[LI]" we define wt(T;) := X^^Lo ^^(^^"'^)' where wt{v^^^) is the 
Hamming weight of the constant vector v^^^ E F". Let C[Ty]<„ denote the vector space of 
polynomials over C in the indeterminate W of degree at most n. For any subset S C F" we 
define the weight enumerator of S to be the polynomial 

n 

we(5) ■.= ^ajW^ e C[W]<n, where aj := #{a £ 5 | wt(a) = j}. 

j=0 

Recall that the classical MacWilliams Identity for block codes states that if C C F" is a 
A;-dimensional code and F = Fg is a field with q elements, then 

we(C^) = g-*^H(we(C)) (2.3) 

with H being the MacWilliams transform 

H : C[I^]<„ ^ C[^]<„, Il{f){W):={l + {q-l)Wrf{j^^^). (2.4) 

It should be kept in mind that H depends on the parameters n and q. Since throughout this 
paper these parameters will be fixed we do not indicate them explicitly. 

A central tool for the purpose of our paper is the description of a CC by the controller 
canonical form (CCF). It will allow us to introduce the main object, the WAM, as well as 
two block codes associated with a CC that are crucial for our investigation. Even though the 
CCF can be found in any textbook on control theory, we choose to present it here explicitly 
since many of our matrix identities later on will rely on the precise form of the matrices. 

Definition 2.1 Let G G F[D]'^^" be a minimal encoder with Forney indices 6i, . . . ,6r > = 
6r+i = . . . = dk and degree 6 := X]i=i ^i- ^et G have the rows gi = X]v=o 9i,vD^ ■, i = I, ■ ■ ■ 
where gi^i, £ F". For i = 1, . . . , r define the matrices 



/O 1 

A^=i ••. ] € F'^'^'^% Si = (1 ••• 0)e¥^\Gi 




( 9i,i 
\9iA 



€ F' 



•SiXn 
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The controller canonical form ( CCF) of G is defined as the matrix quadruple {A, B, C, E) G 



We can {A,B,C,E) a CCF of the code C C F[Z)]" if {A,B,C,E) is the CCF of a minimal 
encoder of C. 

It is well-known that the CCF describes the encoding process of the matrix G in form of 
a state space system. Indeed, G{D) = B{D-^I - A)-^G + E, see [2 Prop. 2.1, Thm. 2.3]. 
As a consequence, one has for u = X]t>o ^t^* ^ F[L)]^ and v = Ylt>o '^tE>^ G F[D]" 

v = uG^[ ""'^^ " "^'j, + ""^^ for alH > ol where xq = 0. (2.5) 
\ vt = xtG + utE - / ^ ^ 

We call F'' the state space of the encoder G (or of the CCF) and xt € F'' the state at time t. 
The following two block codes are naturally associated with a given code. 

Definition 2.2 For a code C C F[Z)]" define the associated block codes Cconst •= 

CnF" and 

Ccocff '■= {w € F" I 3 = Ylt>o '^tD^ G C such that = u; for some t > O}. 

Obviously, Cconst IS simply the block code consisting of the constant codewords in C. 
Consequently, this space is generated by the constant rows (if any) of a minimal encoder 
matrix G. The code Ccoeff is the space of all constant vectors that appear as coefficient vectors 
of some codeword. It can easily be described by using a CCF (A, C, E) for C. Indeed, let 
G = Y7>oGtD\ where Gt e F'^^". Then obviously Ccoeff = im (Gj, G^, . . . , G;^)T. Since 
the coefficient vectors of the rows of G are collected in the matrices C and E, this yields 

Ccoeff = im . (2.6) 

In [S*, Prop. II. 7] it has been shown that the two block codes from Definition 12.21 and the 
corresponding codes Ccoeff and Cconst associated with the dual code C are crosswise mutual 
duals. Precisely, we have the following result. 

Proposition 2.3 Let C he an (n, k, 5) code over F^ with r positive Forney indices, and let 
the dual C have r positive Forney indices. Then dim Cconst = k — r, dim Cconst = n — k — r, and 
dimCcoeff = k + r, dimCcoeff = n — k + r. Furthermore, (Ccoeff)"*" = Cconst; and, consequently, 

gr'^+^'we (Cconst) = H(we(Ccoeff)) • 



3 The Weight Adjacency Matrix of a Code 

The weight adjacency matrix as defined below has been introduced in p[8] and studied in 
detail in [7j as well as [8j. The aim of this section is to present the basic properties of the 
weight adjacency matrix for a given CC as well as to formulate our main result. 

Recall from ()2.5p that the controller canonical form of an encoder leads to a state space 
description of the encoding process where the input is given by the coefficients of the message 
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stream while the output is the sequence of codeword coefficients. The following matrix 
collects for each possible pair of states {X, Y) the information whether via a suitable input u 
a transition from X to y is possible, i. e., whether Y = XA + uB for some u, and if so, 
collects the weights of all associated outputs v = XC + uE. 

Definition 3.1 Let G € F[L>]'=^" be a minimal encoder with CCF {A,B,C,E). The weight 
adjacency matrix (WAM) A := A(G) G C[VF]'' ^'^ of G is defined to be the matrix indexed 
by (X, y) G F"^ X F*^ with the entries 

Kx.Y ■■= we({XC + uE\u(^¥^ -.Y = XA + uB}) G C[VF]<„. (3.1) 

Observe that if (5 = the matrices A, B, C do not exist while E = G. As a consequence, 
A = Ao,o = we(C) is the ordinary weight enumerator of the block code C = {uG | u G F'^} C 
F". 

The WAM contains very detailed information about the code. The classical path weight 
enumerator |T2| p. 154], the extended row distances the active burst distances [9] as 
well as the column distances of the code can all be computed from the WAM, see [18], [12\ 
Sec. 3.10] and 0. For the relevance of these distance parameters for the error-correcting 
performance of the code see [l3] , [9] 

Let us illustrate the matrix by an example. 
Example 3.2 Let F = F3 and 



1x3 



It is easy to see that G and G are minimal and basic and satisfy GG"*" = 0. Thus, the codes 
C := imG and C := imG are mutual duals. The CCF's of the given encoders G and G are 



{A,B,G,E) 

and 



1\ A 0\ /O 1 0\ A 2 
0/ ' lo j ' ll j ' 1 1 2 



(AS,C,fi)=((» ;).(! 0).(; ° J),(2 2 2)), 

respectively. Using the lexicographic ordering of the states in F^ 

(0,0), (0,1), (0,2), (1,0), (1,1), (1,2), (2,0), (2,1), (2,2), (3.2) 
the associated WAM of G is given by 

/ l+2W^ 2W^+W^ 2W^+W^ \ 

2W+W^ 2W'^+W^ W+2W^ 

2W+W^ W+2W^ 2W^+W^ 

W+2W^ 2W+W^ 2W^+W^ 

A= 2W'^+W^ 2W+W^ W+2W^ 

2W'^+W^ 1+2H/2 2W^+W^ 

W+2W^ 2W^+W^ 2W+W^ 

2W^+W^ 2W^+W^ 1+2W^ 

\ 2W'^+W^ W+2W^ 2W+W^J 
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For instance, the entry at position (6, 2) is obtained as follows. Since the 6th state is X = (1, 2) 
and the 2nd state is y = (0, 1) we have to consider the outputs v = (1, 2)C + {ui, U2)E = 
{2 + UI+U2, 1 + 2^1, 2n2), where (ni,n2) € is such that (0, 1) = (1, 2)yl + ('Ui, U2)B. Since 
(1, 2)yl + (til, U2)B = (ui, 1) this is the case if and only if = and we see that the entry at 
position (6,2) is given by we{(2+W2, 1, 2n2) | ii2 = 0, 1, 2} = we{(2, 1, 0), (0, (1, M)} = 
2VF^ + W^. Likewise the WAM associated with the state space realization [A, 13, C, E) of C 
can be computed as 



A 



/I 





















o\ 
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wj 



(3.3) 



As one can see, the WAM contains a considerable amount of redundancy in its entries. For 
further details we refer to [HI Sec. III]. 

It is clear from Definition 13. II that the WAM depends on the chosen encoder G. In order 
to describe this dependence we associate with any P G GL5(F) the permutation matrix 



V(P) G GL i(C), where V(P)xy = \\iY = XP and V{P)x,Y = else. 



(3.4) 



Furthermore, let 11 := {'P(P) | P G GL5(F)} denote the group of all such permutation 
matrices. By definition, the matrix V{P) corresponds to the permutation on the set F"^ 
induced by the isomorphism P. Obviously, for any matrix A G C[VF]'^ ^'^ and any V := 
V{P) G n we have 

[VKV-^)^y = Axp,YP for all {X,Y) G F^ x F^ (3.5) 
In [71 Thm. 4.1] it has been shown that for a given code C 

A(Gi) = rA{G2)V'^ for some V eU. (3.6) 

A(G) the 

(3.7) 



Gi, G2 G F[D]'=^" 

are minimal encoders of C 



As a consequence, for a given code C with minimal encoder G and WAM A 
equivalence class 

[A] := {VAV-^ \V eU} 



forms an invariant of the code. It is called the generalized WAM of C. 
For the rest of this paper we will fix the following data. 

General Assumption 3.3 Let F = Fg be a field with q = elements. Let C C F[Z)]" be 
an {n,k,6) code with r nonzero Forney indices and define !F := ¥^ x F^. Furthermore, let 
G G F[D]*^^"' be a minimal encoder of C with the first r rows corresponding to the nonzero 
Forney indices. Let {A, B, C, E) be the corresponding CCF and A be the associated WAM. 
Likewise, let the dual code C have r nonzero Forney indices and let G G Y[D]^"'~^^^'^ be 
a minimal encoder with the first r rows corresponding to the nonzero Forney indices. Let 
{A, B, G, E) be the corresponding CCF and denote the associated WAM by A. 
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Recall from (I2.2p that C and C both have degree 6 and thus the WAM's A and A are both 

In order to formulate our main result, we need to introduce a certain transformation ma- 
trix. They are well known from the Mac Williams Identity for the complete weight enumerator 
for block codes. Choose a primitive p-th. root of unity G C* and consider the trace form 
r : ¥q — > Fp, a i — > X]i=o Then we define the Mac Williams matrix to be 

n:=q-Uc^''^'A GC«'"^'. (3.8) 

Now we are ready to present our main result. 

Theorem 3.4 Let C and C and the associated data be as in General Assumption \3.3l Then 
there exists some P E GL5(F) such that 

Ax,Y = q'''n[{nK^H-^)xp,Yp) for all {X, Y) G T, (3.9) 

where H is as in (j2.4p . As a consequence, the generalized WAM's satisfy 

[A]=q-^H{n[A]^n~^). (3.10) 

In other words, the matrix g^'^H(7^A^7^^^) is a representative of the generalized WAM of C. 

Recall that, due to (j3.6p . the WAM's for two different minimal encoders of C differ by 
conjugation with a suitable matrix V{P) E 11. This explains the presence of the matrix 
P E GL5(F) in (j3.9p . Of course, P depends on the chosen encoders G and G. In terms of the 
generalized WAM's, however, no specific representation of the code and no transformation 
matrix are needed anymore. Note also that in the case where (5 = 0, the identity (j3.10p 
immediately leads to the Mac Williams identity for block codes as given in (j2.3p . 

The proof of Theorem 13.41 is rather technical and will be presented in the next section. 
The resulting version including an explicit transformation matrix P will be summarized in 
Theorem 13.41^ at the end of the next section. 



4 Proof of Theorem 13.41 

Let the data be as in General Assumption l3.31 The following simple properties of the matrices 
in a CCF will come handy throughout this section. 

Remark 4.1 The matrices {A,B,C,E) as in Definition 12.11 have the following properties. 

(i) AB'^ = 0, BB'^B = B, AA'^ A = A, 

(ii) imS"^ = im (/^, 0) C F'^ and ker B = im (0, Ik-r) ^ F*', 
(in) im A n im5 = {0}, 

(iv) Cconst = (keri?)ii^ := {uE \ u E ker 5} and imL^ = im ® C const, 

(v) ker An ker C = {0}, 

(vi) (ker A)C7n Cconst = {0}, 

The first 4 properties are easily verified, see also [HJ Rem. II.4, Rem. II. 6]. The last two 
properties are due to the fact that the encoder matrix G = B{D^^I — A)^^C + E is minimal. 
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Indeed, notice that ker ^ = spanjj-jejj \ I = 1, . . . ,r}, where ji = Yl\=i ^'^^ where ei, . . . , 
denote the standard basis vectors in ¥^ . Using G as in Definition 12. II we see that Cjfi = gi^Sn 
the highest coefficient vector of the Ith row of G. RecaUing that for a minimal matrix G the 
highest coefficient vectors gi^s^ ■ ■ ■ idk.Sk ^'^^ hnearly independent and noticing that Cconst = 
spanp{gr+i,5^+i, • • • ,9fc,5fc}, one easily derives properties (v) and (vi). 

In the sequel the spaces 

A:=im(^^ and l^:={(X,y)eA|XC + yB'^^GCconst} (4.1) 

will play a crucial role. Notice that 

A = {(X, Y)er\Y = XA + uBioT some n G F'^} = {(X, G | Ax,y / 0}, (4.2) 

that is, A is the space of all ordered pairs of states (X, Y) admitting a direct transition 

Y = XA + uB for some suitable input u. The set il. describes those state pairs for which one 
of the transitions leads to zero output. Indeed, we have 

Proposition 4.2 n = {{X, Y) e A \ 3 u e : Y = XA + uB, = XC + uE}. 

Proof: We will make use of Remark KT\ i) and (iv). For "C" let {X,Y) G ft. Then 

Y = XA + uB for some n G and we compute XC + YB'^E = XG + XAB'^ E + uBB'^ E = 
XG + uBB'^ E. Since, by assumption, this vector is in Cconstj we obtain XG + uBB^ E = u'E 
for some u' G ker B. Now XG + {uBB'^ - u')E = and therefore (X, Y) = (X, XA + uB) = 
(X, XA + [uBB^ — u')B) is in the set on the right hand side. 

For "5" let Y = XA + uB and = XG + uE. Using Remark and (iv) we compute 

XG + {XA + uB)B'^E = XG + uBB'^E = XG + uE + u{BB'^ - I)E 

= u{BB'^ - I)E G (ker B)E = Cconst- 

As a consequence, (X, y) G $7. □ 

The following results will be crucial. The first three statements are easily obtained 
from the form of the matrices {A,B,G,E) and can be found in ^ Prop. III. 6, Lem. III. 7, 
Prop. III. 11]. The last result needs some more detailed considerations and has been proven 
in [HI Lem. III. 9], where the space ft appears as ker$. 

Proposition 4.3 

(a) dim A = 5 + r. 

(b) The orthogonal of A in T is given by A-^ = {{XA'^, -XA'^A) | X G F*^}. 

(c) A e A- = J^, where A' := {{0,Y) \ Y G im^}. 

(d) dim Q = 5 — r, where r is as in General Assumption [ 



In the paper [8], a weak version of the Mac Williams Identity 13.41 has been established. In 
order to present that result, we define 

Mo := I -^x^^T GE'^B\ ^ ^2Sx2S ._ -^^^^ ^4 3) 
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Let us also consider the dual versions of the spaces in ()4.ip and Proposition 14.3( c): that is, 
let A, ri, and A~ denote the respective spaces associated with the dual code C. In the sequel 
we will make frequent use of the dual results of Proposition 14.31 From [U Lem. V.3] it follows 
that 

0©A-=kerMo, Mo<^n^, and TWq © A^ = O^. (4.4) 

Notice that, according to Proposition I4.3r a) and (d) and their dual versions, dimil = 5 — 
r = dimA"*-. Now let us choose a direct complement A* of ^2 in A and let ^ be a direct 
complement of Q.-^ in JF. Then dimC/ = 25 — {5 + r) = 25 — dim A = dim A^. Furthermore, 
let /o : A* — > Mo be the isomorphism {X,Y) \ — > {X^Y)Mq. All this leads to the diagram 

A 



A* 

fo 

Mo 



h 

A^ 



A- 

/2 



(4.5) 



where, due to the dimensions, there exist vector space isomorphisms /i : VL — > A and 
/2 : A~ — > Q in the last two columns and where / = /o © /i © /2- 

Now we can present a cornerstone in the proof of the MacWilliams Identity. The fol- 
lowing weak version of the identity has been proven in [HI Thm. V.5]. It shows that A and 
q-^n{nK^n~^) have the same entries up to an automorphism / on the space of state 
pairs. 

Theorem 4.4 Consider the diagram (|4.5p . Tiien 

Aj-i(_y,x) = q''''H{{nA^n~^)x,Y) for all {X,Y) G 
where f is the automorphism on T defined as / := /o © /i © /2- 

It is worth being stressed that in this theorem the spaces A* and G are any arbitrary direct 
complements of in A and of il-*" in J^, respectively. Also, the isomorphisms /i and /2 
are not further specified. In order to prove our main result. Theorem 13.41 we will use this 
remaining freedom such that the resulting automorphism / = /o © /i © /2 is of the form as 
desired in Theorem 13. 4[ More precisely, we need / to respect the decomposition = F*^ x F^, 
that is, 

fix, Y) = (X, Y) ^) for all (X, Y) e T (4.6) 

for some state space isomorphism P € GL5(F). Indeed, with / being of this form we obtain 
f'^{-Y,X) = (XP-\yp-^) and the identity in Theorem 031 turns into 1xp-^,YP-^ = 
q-^U{{nA^n-^)x,Y) for ah {X,Y) G T. This is exactly the statement of TheoremEl The 
rest of this section will be devoted to specifying the choice of the spaces A* and G as well as 
the isomorphisms /i and /2 in Diagram (|4.5p in order to meet the requirement ()4.6p . 
Let us begin with the following technical facts. 
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Proposition 4.5 

(a) Let Hi : T — F'^ be the projection onto the hrst component, thus Ili{X,Y) = X for 
all {X, Y) € J^. Then Hilj^ is injective. 

(b) rank CE'^B = ?. 

(c) ker CE'^B = Hi (SI) = {X £ ¥^ \ 3 u e ¥^ : {X,XA + uB) E n}. 

Proof: (a) Suppose {0,uB) G Q for some u G F''. Then uBB'^E G Cconst- But then 
Remark 14.1( 1) and (iv) along with the full row rank of E yield uB = uBB^B = 0, which 
proves (a). 

(b) Again we will employ Remark HTT i) and (iv). Let X G F^ such that XCE^B = 0. 
Using ()2.6p we have, on the one hand, XC G CcocfT = (Cconst)"*" , where the last identity is 
due to Proposition 12.31 On the other hand, XC G ker(E'"'"i?) = (uhB'^ E)^ . Making use 
of Remark l4.1( iv) and its dual version this yields XC G (Cconst)^ H {vcuB'^ E)^ = (Cconst © 
miB'^ E)^ = (imE^)-*-. But the latter space is identical to imii^, as one can see directly 
from the identity = G{D)G{D)'^ = {B{D-^I - A)-^C + E){B{D-^I - A)-^d + Ey 
and the full row rank of the matrices E and E. Thus we conclude that XC G im£^ = 
Cconst © iTa.B'^ E. Using that B^ BB^ = i?"*", we obtain the existence of some u = uB'^ G F*^ 
such that XC + uBB'^E G C 

const- Along with the identity AB^ — this implies that 
{X^XA + uB) G SI. All this shows that ker CE'^B C IIi^) and, using (a), we arrive 
at dimkerC^"^S < dimni(fi) = dimS7 = 6 -r. Since CE'^B G F"^^"^ this implies r < 
rar\kCE'^ B < rank E'^B. Recalling from Proposition 12.31 that dimCconst = n — k — r, the 
dual version of Remark I4.1( iv) along with rank E = n — k then tells us that rank E^ B = r. 
This finally proves rankCE'^ B = r. 

(c) The inclusion "C" has been shown in the proof of (b). Thus equality of the two spaces 
follows from Proposition 14.3r d) since dimkerCE'^B = 6 — r = dim $7 = dimni(J7). □ 

Part (a) and (c) of the previous proposition give rise to a crucial map. 

Corollary 4.6 Let K := ker CE^B C F^. Then 

a: K — >¥\ X i — >Y such that {X, Y) e n 

is a well-defined, linear, and injective map. Furthermore, K does not contain a nonzero 
a -invariant subset. 

Proof: Well-definedness follows from Proposition l4.5r a) and (c), whereas linearity is obvious. 
As for injectivity, let X G X such that cr{X) = 0. Then (X, 0) G ri, meaning that XC G 
Cconst- On the other hand, (X, 0) G C A tells us that = XA + uB for some u G F''. 
Hence XA = —uB G im^d n imi? and Remark I4.1( iii) implies XA = 0. But then XC G 
(ker^)CnC 

const — {0}) where the last identity is due to Remark I4.1l fvil. As a consequence, 
X G ker A ker C, and due to (v) of the same remark we arrive at X = 0. This proves the 
injectivity of a. 

For the last statement assume that K' is a u- invariant subset of K. That simply means that 
there exists some vector X G if such that cr*(X) G K for all z > 0. Since if C F'' is a finite 
set, this yields that the orbit {(T*(X) | i G No} is finite and hence contains a cycle. In other 
words, there exists some X' G if and some j > such that a^{X') = X'. Without loss of 
generality we may assume X' = X. By definition of the map a we have ((T*(X), o"*"^^(X)) G 0, 
for all i > 0. Using Proposition 14.21 all this tells us that we have a cycle 

a{X)^ a\X)^ ...^^ a\X)=X 
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of weight zero in the state transition diagram associated with {A, B, C, E). Here the notation 
X—^Y stands for the equations Y = XA + uB, v = XC + uE. It is well-known jUl p. 308] 
that the basicness of the encoder G implies that such a cycle is a concatenation of the trivial 
cycle, that is, X = and = for all i = 0, . . . , j — 1. Thus K' = {0} and the proof is 
complete. □ 

Let us now introduce the matrices 

Sq := B'^E and Si := B'^BA'-^C for i > 1. (4.7) 

Likewise, we define the matrices So := B'^E and Si := B'^BA^^^C, i > I, associated with 
the dual code. Furthermore, we put 

m—l i—1 
m>2 .=1 ,=0 

m-l i-1 ^ ' 

^ ■.= Y.Y.Y.^^^r's,si_^A--^^^'\ 

m>2 i=\ j=0 

Using that A^ = = A^ for i > 5 it is easy to see that these sums are indeed finite since each 
summand vanishes for m > 26. Using two index changes one easily shows that 

m— 1 m 

= E E E (A'y-'SjSl.^A^^-^^^'l (4.9) 

m>2 1=1 j=i+l 

In the appendix we prove the following technical, but straightforward properties. 

Proposition 4.7 

(a) N + N'^ = -CC^ . 

(b) CSl + SqC^ = XA^ A^N'^ . 

(c) NAA^ = N. 

Now we are in a position to work on the remaining freedom in Diagram (j4.5p . Define the 
matrices 

fN -NA\ ( N'^ o\ 

*'' = (o )• "''=[-Pn- oj^ 

Recalling that Sq = B'^E, Proposition 14.71 along with the matrix AIq defined in ()4.3p yields 
M := Mo + Ml + M2 = (^_^p , where P := - iV^. (4.11) 

In the rest of this section we will show that, firstly, the map / induced by Mq + Mi + M2 
is an automorphism, that is, the matrix P € F''^'' is regular, and, secondly, that / respects 
the decomposition of J- on the right hand side of Diagram (j4.5p . As a consequence, / defines 
an automorphism as in Theorem 14.41 that, at the same time, is of the form as in (|4.6p . All 
this will establish Theorem 13. 4i 

In order to carry out these computations notice that M2 = M^ , i. e., M2 is the dual 
version of MJ . From Remark I4.1( i) and Proposition I4.7r c) we obtain 

j B'' 
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Consequently, 

imMi C A-^ and A C ker M2, (4.12) 

where the second containment follows from the first one via duality. The following result 
establishes the regularity of P. 

Theorem 4.8 The matrix P = CSj - NA is in GL5(F). 

Proof: We need to resort to the dual version of Corollary l4.61 Thus, consider K = ker CE^ B 
with the corresponding map a. Firstly, one observes that kerP C K. Indeed, for X € kerP 
we have XNA = XCSq = XCE^ B E im^ fl imS, and from Remark I4.1( iii) we conclude 

XNA = XCE^B = 0. (4.13) 

This proves ker P Q K. In order to show the regularity of P, let X £ ker P. Then X G K 
and thus {X,a{X)) G h. Recalhng that C A we obtain from (jil^ and (fO|) 

{X, d{X)) G ker M2 n ker Mq. (4.14) 

Moreover, {X,a{X))Mi = {XN,-XNA). But XNA = by (ITOD and thus Proposi- 
tion SZJc) yields XN = XNAA'^ = 0. Hence {X,a{X)) G ker Mi, which along with (jilil) 
implies {X,a{X)) G kerM. Consequently, ?(X) G ker P. All this shows that kerP is a 
CT-invariant subspace of K, and by the dual version of Corollary 14.61 we may conclude that 
kerP = {0}. This yields the desired result. □ 

This theorem shows that the map / induced by M = Mq + Mi -|- M2 is an automorphism 
on of the form as in (14. 6p . In order to complete the proof of Theorem 13.41 it only remains 
to show that / is as in Theorem 14.41 that is, that it respects the direct decomposition as in 
Diagram (j4.5p . This is accomplished and summarized in the next result. 



Proposition 4.9 Put A* := ker Mi n A and G := imM2. Then 

(a) ker Mo = A". 

(b) ker Ml = A*eA-. 

(c) kerMa = A* = A. 

(d) imMi = A^ and J^ = n^eg. 

Proof: (a) has already been given in ()4.4p . 

(b) It is clear from the definition of A* and the dual version of Proposition I4.3l fc) that the 
sum A* © A~ is indeed direct and contained in ker Mi. In order to show equality let us first 
compute the rank of Mi . To this end we show that 

f^nkerMi = {0}. (4.15) 

Due to (fiT2]) and part (a) we have that n C ker MoHker M2. Then {X, Y)Mi = {X, Y)M for 
{X,Y) G ri. Now the regularity of the matrix M, see Theorem 14. 8^ implies (I4.15p . Using the 
dual version of Proposition 14.3r d) as well as (I4.12p . we conclude 5 — r = dimil < rank Mi < 
dim A"*-. Since dim A-*- = 6 — r due to Proposition I4.3l fa). this proves 

rankMi=5-r (4.16) 

and 

imMi = A-^. (4.17) 
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Next we show that 



A = A*(£>h. 



(4.18) 



The directness of the sum on the right hand side as well as the inclusion "2" are obvious, see 
also (j4.15p . Furthermore, notice that ker Mi+A = as C ker Mi and A~©A = J^. Since 
ker Ml fl A = A*, we obtain with the aid of Proposition 14.31 that dim A* = dim(kerMi) + 
dim A — dim = r + r = dim A — dim fi. All this proves ()4.18p . Along with the dual version 
of Proposition 14.3( c) we arrive at 

T = A* ®h®A-, (4.19) 

which is exactly the decomposition of J- as in the upper row of Diagram ()4.5p . Now we com- 
pute dim(ker Mi) = S + r = 26- dim Q = dim( A* © A~ ) , which along with A* © A" C ker Mi 
completes the proof of (b). 

(c) Due to (j4.18p it only remains to show that A = kerM2. The inclusion "C" has been 
obtained in (j4.12p . In order to establish identity recall that M2 = M^ and therefore dualiz- 
ing (I4.16P yields rankM2 = 6 — r. But then dim(ker M2) = 6 + r = dimA. Hence ker M2 = A, 
which concludes the proof of (c). 

(d) The first part has already been proven in ()4.17p above. Furthermore, from (c) we know 
that dimC/ = dim(imM2) = 6 — r. Moreover, dim $7^ = 6 + r. Hence the proof of (d) 
is complete if we can show that Q D il^ = {0}. To this end assume {X,Y)M2 G fl'^ 
for some {X, Y) G J^. By (c) and (j4.19p we may assume {X, Y) G A~ and therefore 
(X, Y)M2 = {X, Y)M due to (a) and (b). Furthermore, by (fO]) we have Q-^ = imMo©A-L = 
imMo © imMi. As a consequence, the above yields (X,y)M2 = {Xo,Yo)Mo + (Xi,li)Mi 
for some {Xi,Yi) G .F, i = 1,2. Using (j4.19p and (a) and (b) we may assume {Xo,Yq) G 
A* and {Xi,Yi) G Using once more (a) ~ (c) we conclude {X,Y)M = {X,Y)M2 = 
{Xo,Yo)Mo + (Xi, Yi)Mi = {Xq, Yo)M + {Xi,Yi)M and regularity of the matrix M implies 
{X, Y) = {Xo, Yo) + {Xi,Yi) G A^ n (A* © 17) = A" n A. Thanks to Proposition S^J^c) this 
intersection is trivial and we may finally conclude that G R Q-^ = {0}. This completes the 
proof. □ 

The proposition shows that the space J- decomposes exactly as in Diagram ()4.5p and that 
the matrices Mj, i = 0,1, 2, induce isomorphisms fi,i = 0, 1, 2. As outlined in the paragraph 
right after (14. 6|) , Theorem 14.41 along with ()4.6p , (14. lip and Theorem 14.81 conclude the proof 
of Theorem 13. 4i We summarize the result as follows. 

Theorem 13.41 ^ Let C and C and the associated data be as in General Assumption \3.3l Put 
P := CE^B - NA, where N is as in Then P G GLs{¥) and the WAM's of C and C 

satisfy the MacWiUiams Identity 

Ax,Y = q~'''R{{nA^n'^)xp,Yp) for ah {X,Y) G T. 

Consequently, the generalized WAM's [A] and [A] ofC and C satisfy [A] = q-^Yl{n[A]^ H'^) . 

We close this section with illustrating the MacWilliams Identity for the code in Exam- 
ple [321 

Example 4.10 Let the codes C = imG and C = imG be as in Example 13.21 In order to 
carry out the transformation q^^'iil(l-LK^7i^^) , we need the MacWilliams matrix Ti. With 
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the same ordering of the states as in (I3.2p one obtains 
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, where C, = e ^ . 



Now we may start computing the right hand side of the MacWihiams identity in Theorem l3.4f . 
Using the matrix A from Example 13.21 we obtain T-LK^'H~^ = F, where 
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with < 



/3= + 



f2 
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1/4 



Indeed, using that + C + 1 = 0, it can be checked straightforwardly that TH. = TiA^ . Next 
one easily computes the Mac Williams transforms 3~^H(/j) = W^~^ for i = 1, . . . , 4, where H 
is as in (12.41). and thus one obtains 



$ := 3-2H(r) 
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Finally, we need to apply the state space isomorphism induced by the matrix P = CE^ B 
NA. Since 5 = 2 the matrix N from ()4.8p is given by 



2 
1 



N = SqSI + SqSJa + A^SqSJ + aJSiSI = SqSI + A^SiSl 



This yields P = CE'^B -NA={^^ \y Now one can check straightforwardly that ^xp,yp 

Ax,y for all {X, Y) G where A is the WAM of the dual code given in (13. 3p . This is exactly 
the identity in Theorem 13. 4^ . 
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5 Sequence Space Duality 



In this section we will briefly discuss a different notion of duality for CC's and translate the 
Mac Williams Identity to this type of duality. 

Thus, throughout this section let us call the dual C of a code C C F[L']'^ as defined 
in (j2.ip the module-theoretic dual. The literature on convolutional coding theory has also 
seen a notion of duality based on the F-bilinear form 

F[Z?]" X F[D]" F, [Y.'^tD\ Y.'^tD') ^ {C£vtD\ Y.'^tD')) :=Y.vtwJ. 

t>0 t>0 t>Q t>Q t>0 

Notice that this sum is indeed finite since the vectors are polynomial. The dual based on this 
bilinear form is usually, and most conveniently, defined in the setting of Laurent series, see, 
e. g., [5], [6], [H], [H]. But we can just as well stay within our polynomial setting. Then it 
amounts to defining the dual of the code C as 

C:={we ¥[D]" \ {{v, D^w)) = for sl\ v e C and I € Nq}. (5.1) 

We call C the sequence space dual of C. It is easy to see that C is a submodule of F[D]". 
Furthermore, there is a simple relation between the sequence space dual C and the module- 
theoretic dual C. Indeed, it is not hard to see that C is the time reversal of the module- 
theoretic dual C, or, equivalently, C is the module-theoretic dual of the time reversal of C, 
\\.2\ Thm. 2.64]. Here, the time reversal code is obtained from the primary code by reversing 
the time axis. In our purely polynomial setting, the reversal code can simply be defined as 
follows. If G € F[L']*''^" is a minimal encoder of the code C with row degrees 5i, . . . , 5^, then 
it is easy to see that the reciprocal matrix 




\ 



G{D-^) G F[Z)]*^^" (5.2) 



is minimal and basic as well and has the same row degrees 5i , . . . , (5^ . The code rev(C) := imG' 
is called the reversal code of C. Thus, the above may be summarized as 

C = rev(C) = rl5^). (5.3) 



We briefly wish to mention that in [19j yet another notion of duality has been introduced, 
based on local branch groups. It is lengthy, but straightforward to show that for convolutional 
codes this type of duality is identical to sequence space duality. We omit the details, but 
only want to point out that the definition via local branch groups as given in [19] has the 
advantage to circumvent certain finiteness issues arising for sequence space duality in the 
Laurent series setting. 

In the rest of this section we will derive a Mac Williams Identity for the dual pairing (C, C). 
Due to the close relationship between the module-theoretic dual and the sequence space dual 
this can indeed be deduced from our previous result. Since a time reversal of the state space 
system in (12. Sp essentially amounts to swapping X and Y in (j3.ip . it should be intuitively 
clear that the WAM of rev(C) will essentially be the transposed of the WAM of C. However, 
this is true only when choosing the right state space representations. This will be carried out 
in the following computations. In a first step we need a CCF of rev(C). 
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Proposition 5.1 Let the data be as in Definition \2.1[ Furthermore, let G' be the reciprocal 
matrix of G as in Then the CCF of G' is given by {A, B, G', E'), where 



C' 
E' 



and 



R 



Rr 



\BR I- BB'^ 



G GL5(F) with Ri 



€GL5,(F) 



(5.4) 



Moreover, the matrix L 



RA^ RB^ 
BR I - BB' 



j] satisfies LLJ = Is+k, thus L E GLs+k{^)- 



Proof: Since G and G' are both minimal with the same row degrees 6i, ... ,6k, it is clear 
that the CCF of G' has, just like G, state transition matrix A and input-to-state matrix B. 
The identities for G' and E' follow straightforwardly from the form of A, B, G, E as in 
Definition 12.11 along with the simple matrix identities 



A'^A + B'^B = I, I- BB'^ 
as well as the fact that 





/fe_. 



R = R-^ = and RA'^R = A 



(5.5) 



C" 



where G' 



( 9i,5,-i\ 



ai,i 

V 9i,o j 



and E' 



( 9iM \ 

9r,5r 
9r +1,0 

\ 9k,o J 



The identity LL^ = Is+k can easily be verified using (j5.5p and Remark k.lT i). 
Now it is easy to present the WAM of the reversal code. 



□ 



Corollary 5.2 Let A be the WAM of C associated with the CCF {A,B,C,E). Then the 
WAM A' of the reversal code rev(C) associated with the CCF {A, B, G' , E') given in Propo- 
sition 15. Jl satisfies 

A'xy = Ayr,xr for all {X, Y) € J^, (5.6) 
where R e GLs(¥) is as in IK^i . 

Proof: From (jM]) we have A'^^ y + ^) ^ A and Ayr^xr ^ {YR, XR) G A. 

Hence we first have to show that {X, y) G A <^=^ iXR, XR) € A. Using the definition of A 
in (|4.ip as well as the matrix L from Proposition 15.11 and the identities in (j5.5p we obtain 



im 



/ A 
B 



R 
R 



im 



AR R 
BR 



imL 



/ A 
B 



mi 



/ A 
B 



This shows that {X, F) G A iff {YR, XR) G A and it remains to prove for {X, Y) G A. 
From p Lem. III. 8] we know that for {X, T) G A 

^x,Y = we(XC' + YB'^E' + C^^J and Ayr,xr = we{{YR)G + {XR)B^E + Ceonst) • (5.7) 



16 



Since C const is generated by the constant rows of the minimal encoder G, it follows directly 
from the definition of the reciprocal matrix in ()5.2p that C'^o^^t = C const- Furthermore, since 
{X, y) € A, there exists u such that Y = XA + uB. Using Proposition 15.11 and (15. 5p as 
well as Remark I4.1f i) we compute 

XC + YB'^E' = XRA^C + XRB'^E + YB'^BRC + YB^{I - BB'^)E = 
= XARC + XRB'^E + XAB'^BRC + uBB'^BRC 
= {XA + uB)RC + {XR)B'^E = {YR)C + {XR)B'^E 

With the aid of this proves ([SSI) for all (X, Y)(^T. □ 

Now it is straightforward to formulate and prove a Mac Williams Identity for the sequence 
space dual code. The transformation matrix Q, needed for the identity, will be given explicitly 
in the proof. 

Theorem 5.3 Let C C F[D]" he as in General Assumption 13.31 and let C he the sequence 
space dual of C. Let {A,B,C,E) he a CCF of C and let A he the associated WAM. Then 
there exists a matrix Q G GL5(F) such that 

^XQ,YQ = q~^il(nAn~^)x,Y for aU X,Y € F^. 

As a consequence, the generalized WAM's of C and C satisfy [A] = q-^Yl{n[K\n-^) . 

Proof: Let C = rev(C) and let A' be the WAJ4 associated with the CCF {A,B,C',E'), 
where C", E' are as in Proposition 15.11 Then C = C, due to ()5.3p . Recall the matrix R 
from ()5.4p . By Theorem 13. 4f we have 

^XRP-^,YRP-^ = q-''il{nA'^n-^)xR,YR for ah {X,Y) E J^, 

where P := CE'^B - NA and N is as in (]4.8p with Sj and Sj replaced by S'j and Sj defined 
via the CCF's {A,B,C',E') and {A,B,C,E), respectively, as in gZD- Let V := V{R), 
see ()3.4p . Using ()3.5p we obtain 

{nA''^n-^)xR,YR= ((.vnv-^){VA'^v-^){vnv-^)-^) 

But now the definition of Ti in (j3.8p along with (j3.5p and the identity RR^ = I shows 
that VHV^^ = n. Moreover, by Corohary O and (fSTSl) we have VA''^V'^ = A. All this 
establishes Theorem 15.31 with the transformation matrix Q := RP~^. □ 

Conclusion 

We established a Mac Williams Identity for convolutional codes. It consists of a conjugation 
of the weight adjacency matrix followed by the entry wise Mac Williams transformation for 
block codes. The identity applies to both module-theoretic duality as well as the sequence 
space duality. The result opens the door to investigating self-dual convolutional codes (with 
respect to any duality notion) with the aid of invariant theory. This will be pursued in a 
future project. 
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Appendix A 

In this section we prove the purely matrix theoretical results of Proposition 14. 7i As before, 
the data are as in General Assumption 13. 3i Since G = E + Y2i>i BA^~^CD^ we have B^G = 
'^i^^SiD^ with the matrices Si as given in (j4.7p . Thus, B^GG^B = implies 

m 

SiSj,_i = for all m > 0. (A.l) 

2 = 

Using the CCF, it is easy to see that J2i>iiBA'--^y {BA'-'^) = Is. This in turn yields 

G = (A.2) 

and, consequently, 

m— 1 

m>2 i=l 

Now we are ready for the 

Proof of Proposition 14. 7t (a) From (jA.ip we obtain 

i—l m 

OiJrn-i ~ ~ / J '-'j'-'m—j ~ / J '^j>^m-j 
j=0 j=i+l 

for i = l,...,m — 1. Using (jA.SP and N and N'^ from (|4.8p and (|4.9p we therefore compute 

■m— 1 
m>2 i=l 

m—l i—l m 

= E E(^^r'(E5^^-^--.+ E 5^.5;i;-,>'"-(^+^) =iv+iv^ 

m>2 1=1 j=0 j=i+l 

which is what we wanted. 

(b) Using again (j4.9p one obtains 

(m~l i—l m—l m n 

Y,Y.^A'r'^,si_^A^-^ + E 

(m— 2 i m—l m \ 

y.y.^^)%si^^a-^^^^^+y: e {A^)%si-,A-^'^A 
uL^^ i=0 i=0 1=1 j=i+l ^ 

^ m— 2 m \ 

= E ( E(^)^(E^^-^--.)^™'^^^'^+^os;!;^"^-' + (i^r-i5^5oM 

m>2 ^ i=l j=0 ^ 

Due to (|A.ip the inner sum over j vanishes, and adding = S^Sj + SiSq , which is (jA.ip for 
m = 1, we proceed with 



NA + A^N^ = [SoSlA"^-^ + {A^r-^S^Sj) + ^0^7 + SiS^ 

m>2 

= Y (SoSlA^-' + {A'y'^-^S^Sj) = 5oCT + CS^, 



m>l 
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where the last identity is a consequence of (lA.2p . This proves part (b). 
(c) As before let ei, . . . ,es be the standard basis vectors of F*^. Throughout the rest of this 
proof denote, for any matrix M, the 7-th column (resp. 7-th row) of M by (resp. 
mW). Let us assume that the matrices A and B are as in Definition 12.11 Then we have 
ker A = span^jej; \ I = 1, . . . ,r}, where ji = YlL=i ^a- Moreover, AAJ is the diagonal matrix 
with {AAL^)j^^j^ = for / = l,...,r and {AA^)i^i = 1 else. Therefore, it suffices to show 
that the /U-th column of is zero for all /i € {ji, . . . , jV }- Thus, let /U = 5a for some 

Z = 1, . . . , r. In order to prove the desired result we will even show that 

(S'J^_j.4™~^~^)(^) = for all m > 2 and 1 < i < m - 1 as well as < j < « - 1. (A.4) 

This, of course, implies A(^) = due to (14. Sh . In order prove ()A.4|) notice that 

Put V := X]!i=i + 1- The definition of A and B shows that 

[BA^-'-^)^^) + ^ {A^-'-^\y. = \^bi-\ = m-i-\^i = m-8i. 

Hence for i ^ m — 5i "we have = and it remains to prove (IA.4P for the case 

i = m — 61. In that case 0<j<m — (5/ — 1 implies 61 < m — j. Using that (B'^B)^'^^ = e,^, 
the j/-th row of Sm-j is 

(Sm-j)^"^ = iB'^BA"'-^-^C)'^''^ = (A'^-^-^C)^"^ = {A"'-^-^)^^^C = 0, 

where the last identity follows from the simple fact that the l-th. diagonal block of A"^~^~^ 
is zero, as m — j — 1 > 5i. Transposing the obtained identity yields (S'J^_j)(,y) = 0. Since 
= = ej, we obtain 

This proves ()A.4p for the case i = m — 6i and thus concludes the proof of Proposition 14. 7i □ 
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